P/3Sl f l 




- 1 - 

TITLE OF THE INVENTION 
IMAGING APPARATUS CAPABLE OF ADDING TOGETHER SIGNAL 
CHARGES FROM PIXELS AND READING OUT THE ADDED PIXEL 
SIGNALS 

5 CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is based upon and claims the 
benefit of priority from the prior Japanese Patent 
Applications No. 2000-022758, filed January 31 , 2000; 
and No. 2000-117738, filed April 19, 2000, the entire 
10 contents of which are incorporated herein by reference. 

BACKGROUND OF THE INVENTION 
The present invention relates to an imaging 
apparatus which has an image pick-up device, such as a 
CCD, built in, and more specifically to an image 
15 apparatus which permits the device sensitivity to be 

increased by adding together signal charges produced 
from pixels in the device. 

The present invention also relates to an imaging 
apparatus which uses a color image pick-up device 
20 having a color filter of Bayer arrangement, and more 

specifically to an image apparatus which permits the 
device sensitivity to be increased by adding together 
signal charges produced by pixels in the device. 

In recent years, digital still cameras as an 
25 electronic imaging apparatuses (i.e., electronic 

cameras) have been intensively developed which are 
adapted to capture the image of a subject on the 
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built-in image pick-up device (hereinafter referred to 
as the imaging device), such as a CCD, and produce a 
corresponding still or video image signal to reproduce 
the image. In the recent digital camera, number of 
5 pixels are so increased as to have an improved image 

quality but it is still required that shots are 
continuously photographed at a short time period. 
Accordingly, it is necessary to improve a circuit 
system of processing an image so as to satisfy the 

10 above requirement. That is, there is required to 

propose an improved method of reading an image formed 
on an imaging device having an increased number of 
pixels at a high speed-reading rate and a high frame 
transfer rate. To achieve the requirement, in such 

15 imaging apparatuses, for example, in still-image or 

moving-image apparatuses, it is said that, though image 
resolution is reduced, the sensitivity of the imaging 
device can be increased by adding together signal 
charges from adjacent pixels of same color, for example, 

20 a total of four pixels: two pixels of same color 

adjacent to each other in the vertical direction and 
two pixels of same color adjacent to each other in the 
horizontal direction. 

Specific methods for adding together signal 

2 5 charges include external digital addition by which each 

signal charge, i.e., each pixel signal, is sequentially 
read from the imaging device in accordance with 
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standard techniques and then subjected to 
analog-to-digital conversion and the resulting digital 
pixel signals are added together in digital circuitry 
and internal analog addition by which analog signal 
5 charges are added together as they are on transfer 

paths in the CCD imaging device. The internal analog 
addition requires some modifications to be made to the 
transfer-driving scheme of the imaging device. 

These techniques applied to digital cameras may 

10 possibly result in an increase in the sensitivity of 

the imaging device. However , noise is produced at the 
time of addition, increasing noise in the image signal. 
This may cause degradation in image quality in addition 
to degradation in resolution due to a reduced number of 

15 effective pixels. 

Some conventional publications describe that, when 
signal charges from four pixels are added together, the 
sensitivity of the imaging device is apparently 
increased by a factor of four. That is not necessarily 

20 correct in view of noise produced in the imaging device, 

The reason is as follows: The effect of improving the 
SN ratio by adding together signal charges is known to 
be proportional to the square root of the number of 
signals to be added together from statistical 

25 properties of random noise. Although the signal level 

is increased by four times by adding together signals 
from four pixels , the SN ratio can only be expected to 
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increase by a factor of two (i.e., 6 dB). When 
shooting is made with the image quality, i.e., the 
noise level, kept, therefore, the sensitivity can only 
be increased, at a maximum, by a factor of two, in 
5 other words, the exposure can only be reduced, at a 

maximum, by a factor of two. If, to obtain four times 
the sensitivity, shooting were made at one-quarter the 
exposure and signals from four pixels ware added 
together, the signal level S would be increased by a 

10 factor of 1/4 x 4 = 1 and the noise component would be 

increased by a factor of 1 x ^ 4 = 2, resulting in a 
reduction of 6 dB in the SN ratio. 

Consider here that the imaging device is exposed 
at one-half the exposure in the case where signals from 

15 four pixels are added together. With the external 

digital addition, each signal from the imaging device 
is at a level of 1/2 and hence the noise level is 
relatively increased by a factor of two. Analog 
(random) noise is reduced by a factor of 1/^/ 4 = 2 by 

20 the subsequent addition of signals from four pixels. 

There is therefore no problem with respect to the 
random noise. On the other hand, quantization noise is 
not reduced even by the signal addition and remains at 
a relative level of two, causing degradation in image 

25 quality as described previously. With the external 

digital addition, the frame rate remains unchanged from 
that in normal shooting mode and cannot be increased 
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and moreover digital operations must be performed in 
two dimensions , increasing the signal processing time 
for recording. 

On the other hand, the analog addition processing 
5 involves a problem of saturation of charges within the 

imaging device, because the saturated charge amount is 
limited at predetermined values in the charge transfer 
path and an output section of the imaging device. That 
is, the maximum output level of the horizontal transfer 

10 path on which signal charges are added together or the 

output amplifiers of the imaging device in the normal 
read operation is limited to the amount of charge for 
one pixel. However, the addition of signals from four 
pixels at one-half the exposure requires the amount of 

15 charge for two (= 1/2 x 4) pixels to be handled. This 

increase in the amount of charge cannot be accommodated 
by the imaging device and hence signals will be clipped 
within the imaging device, causing the image quality to 
suffer. 

20 Furthermore, since the addition of pixel charges 

within the imaging device is allowed for only signals 
from successive pixels, it is said that the application 
of internal addition processing to the one charged 
coupled device having a Bayer-arrangement color filter 

25 is difficult. The one charged coupled device have 

therefore to depend on a technique which involves 
reading pixel signals once, then adding together 



digital signals of the same color with a digital 
process outside the imaging device. The addition of 
pixel signal with external digital processing is 
complex and takes long because the operations must be 
5 performed two-dimensionally and does not allow for an 

improvement in the frame rate* 

BRIEF SUMMARY OF THE INVENTION 
It is an object of the present invention to 
provide an imaging apparatus which permits pixel 
10 signals to be added together without need of complex 

operation processing to increase the sensitivity and 
the frame rate to be increased. 

It is another object of the present invention to 
provide an imaging apparatus which permits the frame 
15 rate to be increased without causing the image quality 

to suffer and the shooting sensitivity to be increased 
by adding together pixel signals without increasing the 
burden of digital signal processing. 

It is still another object of the present 
20 invention to provide an imaging apparatus which , even 

with a Bayer arrangement color imaging device 
incorporated, permits the frame rate to be increased 
and the sensitivity to be increased by adding together 
pixel signals without need of complex operation 
25 processing. 

According to an aspect of the present invention 
there is provided an apparatus comprising: a color 



imaging device having an interline transfer charge 
transfer paths adapted for interlaced readout and a 
Bayer-arrangement color filter; driving means for 
driving the imaging device which , in addition to normal 
5 signal read operation , allows addition readout for 

reading signals while adding together signal charges 
from a plurality of pixels arranged in the vertical 
direction in the charge transfer paths; addition 
operation means for performing addition operation of a 

10 plurality of pixels arranged in the horizontal 

direction on pixel signals read from the imaging 
device; and mode setting means for setting selectively 
one of a first shooting mode corresponding to the 
normal readout operation of the imaging device and a 

15 second shooting mode, 

when the second shooting mode is set by the mode 
setting means, the driving means performing the 
addition readout on the plurality of pixels in the 
vertical direction and the addition operation means 

20 performing addition processing on alternate pixels in 

the horizontal direction* 

This imaging apparatus may be implemented 
specifically and preferably as follows: 

(1) The number of pixels to be added together in 
25 the second shooting mode by each of the drive means and 

addition operation means is the same. 

(2) There is further provided exposure control 



means for controlling the amount of light falling on 
the imaging device. When the number of pixels to be 
added together by each of the drive means and addition 
operation means is N, the exposure control means sets 
5 the target exposure value in the second shooting mode 

to 1/N the target value in the first shooting mode. 

(3) In the second shooting mode, the driving 
means drives vertical transfer paths in the imaging 
device at twice the rate in the first shooting mode so 

10 that signal charges from two pixels arranged in the 

vertical direction are added together in the horizontal 
transfer path. 

(4) The color filter used with the imaging device 
is an RGB primary color filter. 

15 (5) The imaging device is a CCD imaging device. 

According to the present invention , with the 
Bayer-arrangement imaging device adapted for interlaced 
frame readout, alternate pixels arranged in the 
vertical direction and corresponding to either of odd 

20 and even fields making up one frame are of the same 

color and alternate pixels arranged in the horizontal 
direction, i.e., along each line, are of the same color. 
Therefore, pixels arranged in the vertical direction 
can be readily added together in the horizontal 

25 transfer path. For example, driving the vertical 

transfer paths at twice the normal rate allows two 
pixels arranged in the vertical direction to be added 
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together in the horizontal transfer path. 

After the pixel addition in the vertical direction 
in the horizontal transfer path, pixel addition is 
performed on alternate pixels in the horizontal 
5 direction outside the image device. In this case, one- 

dimensional addition operation suffices, allowing the 
signal processing to be simplified significantly in 
comparison with two-dimensional addition operation. 
The pixel addition in the vertical direction within the 

10 imaging device allows the frame rate to be increased. 

According to another aspect of the present 
invention there is provided an apparatus comprising: a 
color imaging device having an interline transfer 
charge transfer paths; driving means for driving the 

15 imaging device which, in addition to normal signal read 

operation, allows addition readout for reading signals 
while adding together signal charges from a plurality 
of pixels arranged in the vertical direction in the 
charge transfer paths; addition operation means for 

20 performing addition operation of a plurality of pixels 

arranged in the horizontal direction on pixel signals 
read from the imaging device; and mode setting means 
for setting selectively one of a first shooting mode 
corresponding to the normal readout operation of the 

25 imaging device and a second shooting mode, 

when the second shooting mode is set by the mode 
setting means, the driving means performing the 
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addition readout on the plurality of pixels in the 
vertical direction and the addition operation means 
performing addition processing on alternate pixels in 
the horizontal direction 
5 According to still another aspect of the present 

invention there is provided an apparatus comprising: a 
color imaging device having an interline transfer 
charge transfer paths adapted for interlaced readout 
and a Bayer-arrangement color filter; driving means for 

10 driving the imaging device which, in addition to normal 

signal read operation, allows addition readout for 
reading signals while adding together signal charges 
from a plurality of pixels arranged in the vertical 
direction in the charge transfer paths; addition 

15 operation means for performing addition operation of a 

plurality of pixels arranged in the horizontal 
direction on pixel signals read from the imaging 
device; and mode setting means for setting selectively 
one of a first shooting mode corresponding to the 

20 normal readout operation of the imaging device and a 

second shooting mode, 

when the second shooting mode is set by the mode 
setting means, the driving means performing the 
addition readout on the plurality of pixels in the 

25 vertical direction and the addition operation means 

performing addition processing on alternate pixels in 
the horizontal direction. 



The imaging apparatus of the present invention may 
be implemented specifically and preferably as follows: 

( 1 ) The number of pixels to be added together in 
the second shooting mode by each of the drive means and 

5 addition operation means is the same. 

( 2 ) The number of pixels to be added together in 
the second shooting mode by each of the drive means and 
addition operation means is an integer of N not less 
than two . 

10 (3) There is further provided exposure control 

means for controlling the amount of light falling on 
the imaging device. The exposure control means sets 
the target exposure value in the second shooting mode 
to a value not more than 1/N of the target value in the 

15 first shooting mode, especially to 1/N. 

(4) In the second shooting mode, the driving 
means drives vertical transfer paths in the imaging 
device at twice the rate in the first shooting mode so 
that signal charges from two pixels arranged in the 

20 vertical direction are added together in the horizontal 

transfer path. 

(5) In the second shooting mode, the output of 
the addition operation means, after being reduced by a 
factor of N, is subjected to the same video signal 

25 processing as in the first shooting mode is performed 

except processing as to the number of pixels. 

(6) The color filter used with the imaging device 
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is an RGB primary color filter. 

(7) The imaging device is a CCD imaging device. 
According to the present invention , pixel addition 
in the vertical direction is performed through driving 
5' means and pixel addition in the horizontal direction is 
performed through external operations means. In this 
case, the external circuit is required to perform one- 
dimensional addition operation only, allowing signal 
processing to be simplified significantly in comparison 
10 with two-dimensional addition operation. Also, the 

pixel addition in the vertical direction within the 
imaging device allows the frame rate to be increased. 

Since only the addition in the vertical direction 
is performed in the device, the problem of in-device 
15 signal saturation is alleviated in comparison with the 

case where two-dimensional addition is performed in the 
device. 

When the target exposure value for the imaging 
device is set to not more than 1/N (N is the number of 

2 0 vertically-arranged pixels to be added together), the 

amount of charge at the time of addition in the device 
will not exceed the amount of charge for one pixel in 
the normal mode and there will not arise a new problem 
of signal saturation in the imaging device (for subject 

25 brightness level lower than the normal). If the target 

exposure is set to 1/N even when the number of pixels 
to be added together in the horizontal direction is N, 
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the effect of reducing noise by the total addition 
processing will not fall below the degree of a 
reduction in signal components. Thus, the S/N ratio 
will also not be degraded. 
5 With the Bayer-arrangement imaging device adapted 

for interlaced frame readout, alternate pixels arranged 
in the vertical direction and corresponding to either 
of odd and even fields making up one frame are of the 
same color and alternate pixels arranged in the 

10 horizontal direction, i.e., along each line, are of the 

same color. Therefore, pixels arranged in the vertical 
direction can be readily added together in the 
horizontal transfer path. For example, driving the 
vertical transfer paths at twice the normal rate allows 

15 two pixels arranged in the vertical direction to be 

added together in the horizontal transfer path. 

Additional objects and advantages of the invention 
will be set forth in the description which follows, and 
in part will be obvious from the description, or may be 

20 learned by practice of the invention. The objects and 

advantages of the invention may be realized and 
obtained by means of the instrumentalities and 
combinations particularly pointed out hereinafter. 
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

25 The accompanying drawings, which are incorporated 

in and constitute a part of the specification, 
illustrate presently preferred embodiments of the 
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invention, and together with the general description 
given above and the detailed description of the 
preferred embodiments given below, serve to explain the 
principles of the invention. 
5 FIG. 1 is a block diagram of a digital still 

camera according to an embodiment of the present 
invention; 

FIG. 2 schematically illustrates, in plan view, 
the basic structure of the color imaging device shown 
10 in FIG. 1; 

FIG. 3 schematically illustrates a Bayer 
arrangement of RGB filter elements in the color imaging 
device shown in FIG. 1; 

FIG. 4 is a diagram for use in explanation of the 
15 addition of signals from four pixels in the imaging 

apparatus equipped with the RGB Bayer-arrangement color 
filter shown in FIG. 3; 

FIG. 5 is a schematic functional block diagram 
illustrating control functions implemented by the 
20 system controller in the imaging apparatus shown in 

FIG. 1; and 

FIGS. 6A through 6E are timing diagrams for use in 
explanation of the shutter release operation and the 
charge read operation in the imaging apparatus shown in 
25 FIG. 1. 

DETAILED DESCRIPTION OF THE INVENTION 
Referring now to FIG. 1 there is illustrated, in 
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block diagram form, a digital still camera as an 
imaging apparatus according to an embodiment of the 
present invention . 

In FIG. 1, an objective lens system 101 is 
5 composed of multiple lenses , which direct light rays 

from a subject into the camera. The lens system 101 is 
driven by a lens drive mechanism 102 so that it is 
focused on the subject. An exposure control mechanism 
103 , including an aperture and an aperture drive 

10 mechanism, is provided to control the amount of 

incoming light passed through the lens system. The 
light passed through the aperture of the exposure 
control mechanism is directed through a mechanical 
shutter 104 onto a CCD color imaging device 105 

15 equipped on its light receiving surface with a Bayer- 

arrangement color filter. Thus, the image of the 
subject is formed on the CCD color imaging device. 

The CCD color imaging device 105 is driven by a 
CCD driver 106 which produces drive signals to be 

2 0 described later. From the CCD color imaging device are 

produced, for example, red (R) , green (G) and blue (B) 
pixel signals which correspond to R, G and B filter 
elements, respectively, in the Bayer arrangement color 
filter. The resulting R, G and B pixel signals are fed 

2 5 into a preprocess circuit 107 including analog-to- 

digital (A/D) converters and so on, so that they are 
converted into digital form. The digital pixel signals 
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from the preprocess circuit are then entered into a 
digital process circuit 108 where they are subjected to 
color signal production processing , matrix conversion 
processing and other digital processing to form color 
5 image data* The color image data is loaded through a 

card interface 109 into a memory card 110 , such as a 
compact flash memory card or the like and is displayed 
as a color image on an LCD display unit 111. 

The digital still camera of FIG. 1 is equipped 

10 with a system controller (CPU) 112 for controlling the 

components in the camera. When operating switches 113 
including a shutter release button are operated, the 
system controller sets operating modes corresponding to 
the operated switches and then displays the operating 

15 states and the mode settings on an operation display 

unit 114 provided with a LCD or LED. As will be 
described later , operating the switches 113 allows a 
choice to be made between a normal shooting mode in 
which a subject is shot with the normal sensitivity and 

20 a high-sensitivity shooting mode in which the subject 

is shot with sensitivity higher than the normal 
sensitivity. 

The system controller 112 , in response to an 
operation of the release button corresponding to one of 

25 the operating switches 113 , instructs the lens driver 

115 to drive the lens 101 for focusing purpose by way 
of example, whereupon the lens drive mechanism 102 
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moves the lens 101. Thus, focusing is accomplished. 
In a similar way, zooming can also be performed. 
Further, the digital still camera is equipped with a 
flash unit 116 as light emitting means for directing a 
5 flash of light onto a subject, which is controlled by 

an exposure control driver 117 to direct an appropriate 
amount of light onto the subject. The system 
controller is connected with a nonvolatile memory 
(EEPROM) 118 for storing various settings and produces 

10 control signals in accordance with various parameters 

stored in that memory. The control signals are applied 
to the components in the camera. 

In the digital still camera shown in FIG. 1, as 
described above, the system controller 112 controls the 

15 components. In particular, the system controller 

controls the shutter contained in the exposure control 
mechanism 103 through the exposure control driver 117 
and the CCD imaging device 105 through the CCD driver 
106 to carry out exposure (charge storage) and signal 

20 readout. The system controller allows the read signals 

to be fed through the preprocess circuit 107 into the 
digital process circuit 108, then subjects them to 
various signal processes and records them on the memory 
card 110 through the card interface 109. The CCD 

25 imaging device 105 substantially remains unchanged from 

conventional ones and is, for example, a vertical 
overflow drain structure of the interline transfer type, 
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In FIG. 2 are illustrated in block diagram form 
the CCD imaging device 106 and the CCD driver 106 shown 
in FIG. 1. The CCD imaging device is an interline 
transfer (IT) device and driven in accordance with the 
5 interlacing scheme. In the CCD imaging device 105, a 

large number of photodiodes 201, serving as pixels, are 
formed on a semiconductor substrate 200 so that they 
are arranged in a matrix form, i.e., in rows and 
columns. On the semiconductor substrate are formed 

10 vertical CCD arrays (VCCD) each of which forms a 

vertical transfer path 202 provided with transfer gate, 
that transfers charges received from a corresponding 
array of photodiodes in the vertical direction. A 
horizontal CCD array (HCCD), serving as a horizontal 

15 transfer path 203, is formed along the direction of 

arrangement of the photodiode arrays on the 
semiconductor substrate to transfer signal charges 
received from the vertical transfer paths 202 on a 
line-by-line basis in the horizontal direction. 

20 As shown in FIG. 2, the vertical transfer path 202 

provided with the transfer gate is alternately driven 
by odd and even transfer gate (TG) signals and VCCD 
signal supplied from a vertical driver 206 in such a 
manner that charge signals are alternatively read from 

25 the pixels arranged in odd field and even field, 

respectively, and the charge signals as pixel signals 
corresponding to one of the odd and even fields are 
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transferred to the horizontal transfer path. The 
horizontal transfer path 203 is driven by a HCCD signal 
supplied from a horizontal driver to transfer the pixel 
signal in the horizontal transfer path 203 and output 
5 the pixel signal to the preprocess circuit 107 through 

an amplifier 208. The vertical driver 206 is set in a 
normal mode or high speed transfer mode by a transfer 
mode setting circuit 210. The transfer mode setting 
circuit 210 set the vertical driver in the normal mode 

10 in accordance with a normal mode instruction and in the 

high speed transfer mode in accordance with the high- 
sensitivity mode instruction. 

As shown in FIG. 3, the Bayer arrangement color 
filter is formed with R, G and B filter elements in the 

15 Bayer arrangement. With such a Bayer arrangement color 

filter , the addition of signal charges from adjacent 
pixels results in different colors being mixed together, 
It is therefore impossible to mix signal charges from 
different pixels simply. 

20 In the imaging device having R, G and B filter 

elements in the Bayer arrangement and adapted for 
interlacing, pixels corresponding to R and G filter 
elements or pixels corresponding to G and B filter 
elements are arranged in the form of a stripe in each 

25 interlace field. That is, in the odd field, pixels 

corresponding to R filter elements are arranged 
alternately with pixels corresponding to G filter 
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elements, whereas, in the even field, pixels 
corresponding to G filter elements are arranged 
alternately with pixels corresponding to B filter 
elements . 

5 In this embodiment, in the normal shooting mode in 

which the pixel signals from the same color pixels are 
not added, signal charges from pixels in the even and 
odd fields are read out alternately onto the vertical 
transfer paths 2 02 and then transferred to the 

10 horizontal transfer path 203 at the normal readout rate- 

That is, in reading out a frame of image in the 
interlacing system, signal charges from n pixels in the 
odd or even field are read out onto the vertical 
transfer paths 202 and then transferred to the 

15 horizontal transfer path 203. Pixel signals read in 

the odd and even fields and output from the horizontal 
transfer path 203 are processed as one frame of image 
data. 

On the other hand, in the high-sensitivity 
20 shooting mode in which the pixel signals from the same 

color pixels are added, signal charges from pixels in 
the even and odd fields are read out alternately onto 
the vertical transfer paths 202 and then transferred to 
the horizontal transfer path 203 at n times the normal 
25 transfer rate. That is, n-line addition driving is 

carried out. Thereby, the signal charges from pixels 
are added together in the horizontal transfer path 
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without different colors being mixed. Specifically, 
signal charges from n pixels arranged in the vertical 
direction and corresponding to the even or odd field 
are read out onto each vertical transfer path 202 and 
5 then moved into to the horizontal transfer path 203 

where they are mixed together. Pixel signals for one 
frame read out of the horizontal transfer path 203 are 
subjected to digital operations such that signals from 
n pixels of the same color along each line in one frame 

10 are added together and then averaged and are converted 

into one frame of image data. 

As described above, according to the invention , 
both of analog and digital additions are performed in 
the imaging apparatus, the analog addition of the pixel 

15 signals readout in the vertical direction of the pixel 

array being achieved in the imaging device and digital 
addition of the pixel signals transferred in the 
horizontal direction of the pixel array is achieved 
outside of the imaging device. 

20 An example of addition of signal charges from four 

pixels is illustrated in FIG. 4 in which one unit of 
sixteen pixels is shown, a plurality of units of 
sixteen pixels constituting all the pixels of the 
imaging device. As shown, in the odd field, signal 

25 charges from two pixels of the same color (G or R) 

arranged in the vertical direction are added together 
in the horizontal transfer path 203. Likewise, in the 
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even field as well, signal charges from two pixels of 
the same color (B or G) arranged in the vertical 
direction are added together in the horizontal transfer 
path 203. The pixel signals read from the horizontal 
5 transfer path to the outside of the imaging device are 

subjected to digital operations processing so that 
signals from two pixels of the same color along each 
line are added together and then averaged. With the 
addition of four pixels , the exposure used in shooting 

10 is set to one-half the normal exposure. 

There will be described an addition of pixel 
signals in the imaging device composed of the units of 
sixteen pixels, one unit of the sixteen pixels being 
shown in FIG. 4, when a frame is read out in the 

15 interlacing manner, odd lines in the odd field are read 

first and even lines in the even field are read next. 
In the odd field, therefore, the pixel signal Gl and 
the pixel signal G5 are transferred to the first 
vertical transfer path 202 and the pixel signal Rl and 

20 the pixel signal R3 are transferred to the second 

vertical transfer path 202. Also, the pixel signal G2 
and the pixel signal G6 are transferred to the third 
vertical transfer path 202 and the pixel signal R2 and 
the pixel signal R4 are transferred to the fourth 

25 vertical transfer path 202. In the horizontal transfer 

path, the pixel signals Gl and G5 are added together to 
produce a sum signal (Gl + G5). Likewise, the pixel 
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signals Rl and R3 are added together to produce a sum 
signal (Rl + R3), the pixel signals G2 and G6 are added 
together to produce a sum signal (G2 + G6), and the 
pixel signals R2 and R4 are added together to produce a 
5 sum signal (R2 + R4 ) . These sum signals are 

transferred to the outside of the imaging device. 
Outside the imaging device, two sum signals of the same 
color along the same line are added together to yield 
pixel signals {(Gl + G5) + (G2 + G6 ) } and {(R2 + R4) + 

10 (Rl + R3)}. Likewise, in the even field, pixel signals 

(Bl + B3), (G3 + G7), (B2 + B4 ) and (G4 + G8 ) are 
produced in the horizontal transfer path 203. Outside 
the imaging device, signals {(Bl + B3 ) + (B2 + B4 ) } and 
{(G3 + G7) + (G4 + G8)} are produced. Thus, the 

15 addition of signals from four pixels is achieved. 

The above processing can be implemented as shown 
in FIG. 5. That is, in the imaging system corre- 
sponding to the CCD 105 of FIG. 1, the vertical 
transfer paths 2 02 are driven by the vertical drive 

20 pulse supplied from the CCD driver 106 at twice the 

vertical transfer rate in the normal mode so that 
signal charges from two pixels arranged in the vertical 
direction are transferred to the horizontal transfer 
path at different timing and are added together in the 

25 horizontal transfer path 203. In the digital signal 

processing circuit system corresponding to the digital 
process circuit 108, signals output from the horizontal 
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transfer path are processed in such a way that two 
pixels of the same color which are arranged along each 
line which are one pixel apart are added together. In 
the exposure control system corresponding to the 
5 exposure control mechanism 103 driven by the exposure 

control driver 117, the exposure for an image incident 
on the CCD 105 is set to one-half the normally set 
target exposure. It should be noted here that the 
horizontal transfer path 203 is operated in exactly the 

10 same manner as in the normal operation; thus, signals 

are transferred horizontally at the normal horizontal 
transfer rate by horizontal transfer signals from the 
CCD driver 106. Since the addition of pixels in the 
vertical direction has already been made, the digital 

15 signal processing system requires only the addition of 

pixels in the horizontal direction, i.e., one- 
dimensional addition, thus allowing the signal 
processing to be significantly simplified in comparison 
with two-dimensional addition. 

20 The aforementioned two-line addition drive itself 

is a known technique and its detailed description is 
therefore omitted. In brief, the vertical drive pulses, 
while, in the normal operation, being output by the 
number corresponding to one transfer unit during each 

25 horizontal retrace period, are produced by the number 

corresponding to n transfer units during each 
horizontal retrace period. Thereby, signal charges 
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from n pixels arranged in the vertical direction are 
transferred in each vertical transfer path and then 
added together in the horizontal transfer path. 

The unit pixels thus obtained through addition has 
5 the Bayer arrangement as shown in the right-hand 

portion of FIG. 4. Thus, the subsequent brightness and 
color signal production processing can use exactly the 
same algorithm as without pixel addition except that 
the total number of pixels is reduced. When the final 

10 number of pixels to be added together is N x n, the 

number of pixels to be added together in the CCD is N, 
which corresponds to the final amount by which the 
sensitivity is increased (the amount by which S/N ratio 
is increased: random noise is in inverse proportion to 

15 the square root of the number of pixels subjected to 

addition and averaging from its statistical property) . 
Thus, the target exposure value can be set to 1/N of 
the normal exposure value. Therefore, there arises no 
problem associated with saturation which can occur 

20 inside the imaging device (e.g., in the horizontal 

transfer path). For example, in the case of addition 
of four pixels, the exposure is allowed to be 1/2 the 
normal exposure. In other words, in order to prevent 
the S/N ratio from degrading, it is required that the 

25 effect of reducing noise be not counteracted by a 

reduction in the number of signal components and the 
exposure be not less than 1/2 (1/N) the normal exposure. 
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On the other hand, in order to prevent the amount of 
charge resulting from addition of pixels in the 
vertical direction from exceeding the amount of charge 
for one pixel so that no saturation occurs within the 
5 imaging device, it is required that the exposure be not 

greater than 1/2 the normal exposure. One-half the 
normal exposure meets those requirements. 

In the pixel addition mode, the amount of charge 
(voltage level) output from the CCD remains unchanged 

10 from that in the normal mode, causing no increase in 

quantization noise. That the amount of charge remains 
unchanged means that the aforementioned algorithm for 
brightness and color signal production processing is 
allowed to be exactly the same as that without pixel 

15 addition, including processing as to gain and 

gradations. Accordingly, the signal processing can be 
made common to the pixel addition mode and the normal 
mode. 

Considering quantization noise, the gain of analog 
20 amplifiers in the conventional all-digital system may 

be set to twice the normal gain. In this case, analog 
amplifiers having a wide variable range are required. 
This requirement is difficult to meet. Even if such 
amplifiers could be used, there would arise new 
25 problems of noise due to gain control, etc. 

Since the amount of charge (voltage level) at the 
output of the CCD remains unchanged, the analog 
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amplifier gain needs not to be changed. Thus, no 
problem arises anew in connection with the analog 
system (including A/D). The digital addition has a 
noise reducing effect on noise produced in the analog 
5 system. Thus, high sensitivity can be attained with 

more certainty than with the all-digital system in 
which the gain of the analog system generally needs 
to be set higher than that at the time of normal 
sensitivity (in the normal mode in which no addition is 

10 performed) in order to keep quantization noise from 

increasing. In addition, successive shooting can also 
be performed utilizing the increased frame rate owing 
to readout at n times the normal speed. 

Reference is made to timing diagrams of FIGS. 6A 

15 to 6E to describe a shutter releasing operation and a 

charge readout operation in the imaging apparatus of 
the present invention. 

After the mechanical shutter 104 is made to open 
(time tl) as shown in FIG. 6A, the final charge drain 

20 pulse (VSUB) is applied to the CCD 105 at time t2 as 

shown in FIG. 6B. As a result, residual charges are 
drained from the photodiodes, or pixels 201. After 
that, charge storage (exposure) is initiated in the CCD 
array, so that charges are stored in the photodiodes, 

25 or pixels 201. Until the shutter 104 is closed at time 

t4, the charges are stored in the photodiodes during a 
period Texp. The vertical CCD transfer paths 202 are 
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driven during the interval from time tl to time t5 as 
shown in FIG. 6C, so that unnecessary charges are 
drained from the vertical CCD transfer paths. From a 
predetermined time t6 immediately after the time t4 and 
5 the charge drain has been completed, odd-field transfer 

gate pulses are applied to the vertical transfer paths 
202 as shown in FIG. 6D. As a result, signal charges 
in the photodiodes 201 corresponding to the odd field 
are read out to the vertical CCD transfer paths 202 and 

10 then transferred to the horizontal CCD transfer path 

203. At this point, the signal charges from two pixels 
arranged in the vertical direction are added together 
in the horizontal transfer path. After that, even- 
field transfer gate pulses are applied to the vertical 

15 transfer paths 202 from time t6 as shown in FIG. 6E. 

As a result, signal charges in the photodiodes 201 
corresponding to the even field are read out to the 
vertical CCD transfer paths 202 and then transferred to 
the horizontal CCD transfer path 203. In this case as 

20 well, the signal charges from two pixels arranged in 

the vertical direction are added together in the 
horizontal transfer path. 

According to the first embodiment, as described 
above, the use of the mechanical shutter allows pixel 

25 signals to be read with each of odd and even fields. 

And moreover unnecessary charges are drained in the 
state where the shutter is closed. It therefore 
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becomes possible to prevent unwanted charges which may 
cause smear and the like from being mixed as noise in 
an image signal. 

In the imaging apparatus of the first embodiment , 
5 the exposure is set to 1/2 (1/N) the normal target 

exposure. This is intended to keep the image quality 
(S/N ratio) as good as in the normal shooting mode. 
Otherwise , any other exposure setting may be made. An 
example in this case will be described below as a 
10 second embodiment. The second embodiment differs from 

the first embodiment only in that: 

( 1 ) The target value of exposure control is 
1/4 (1/N 2 ). 

(2) The digital operation in the succeeding stage 
15 is addition rather than addition and averaging (the 

operation on two pixels separated by one pixel remains 
unchanged) . 

In the second embodiment , the signal level at the 
output of the imaging device is 1/2 the signal level in 

20 the normal mode. The signal level is restored to the 

normal level through the digital operation. Thus, that 
the exposure is allowed to be 1/4 the normal value 
means that four times as high sensitivity is obtained. 
However, this corresponds to increasing of the gain of 

25 the digital circuit system and hence both analog noise 

and quantization noise increase in comparison with the 
first embodiment. 
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However , since the exposure value for the imaging 
device is set to 1/4 the target value in the normal 
mode in which no pixel addition is performed and this 
satisfies the condition of not more than 1/N (N is the 
5 number of vertically-arranged pixels to be added 

together) , the amount of charge at the time of addition 
in the device will not exceed the amount of charge for 
one pixel in the normal mode and there will not arise 
at least a new problem of signal saturation in the 
10 imaging device (for subject brightness level lower than 

the normal ) . 

Considering only a shot noise corresponding to one 
of noise components, if the exposure value is set to 
1/N time the amount of charge and no pixel signals are 

15 added, a generation of the noise is 1/^/ N time the 

noise level 1 which is generated when the normal 
exposure value is set to 1 . If the exposure value is 
set to 1/N time the amount of charge and four pixel 
signals (N=4) are added, a generation of the noise is 1 

20 ( = 1/ ^/ N x ^ n ) which is same level as that of the 

normal exposure value. Thus, the four additions of the 
pixel signals can maintain the S/N at the time of 
normal exposure . 

The present invention is not to be limited to the 

25 embodiments described so far. Although the present 

invention has been described as using a CCD array as 
the imaging device, any other charge transfer device 
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(CTD), such as a bucket brigade device (BBD) or a 
charge injection device (CID), may be used. The color 
filter need not be limited to an R, G and B primary 
color filters. Instead, a complementary color filter 
5 such as C, M and Y color filters may be used. The 

pixels to be added together need not be limited to two 
pixels in the vertical direction and two pixels in the 
horizontal direction. The number of pixels to be added 
together in each direction may be set according to 

10 specifications. The number of pixels to be added 

together in each direction may differ from that in the 
other direction . 

In the embodiments, the mechanical shutter and the 
interlaced reading are used in combination particularly 

15 for the color imaging device with the Bayer arrangement 

color filter. It is evident that, even with no such 
measures, the present invention can be readily applied 
to single-plate color imaging apparatuses with a 
vertical stripe filter, multi-plate color imaging 

20 apparatuses, or monochrome imaging apparatuses. 

The present invention can be applied not only to 
a digital still camera but also to any other type of 
imaging apparatus including a movie camera. The 
present invention may be practiced or embodied in still 

25 other ways without departing from the scope and spirit 

thereof . 

According to the present invention, as described 
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above in detail , by performing pixel signal addition in 
the vertical direction through driving means in the 
imaging device and pixel addition in the horizontal 
direction through external operations means outside of 
5 the imaging device , the external circuit is required to 

perform one-dimensional addition operation only, 
allowing signal processing to be simplified 
significantly in comparison with two-dimensional 
addition operation. Also, the pixel addition in the 

10 vertical direction within the imaging device allows the 

frame rate to be increased. That is, the sensitivity 
and the frame rate can be increased through pixel 
addition without need of complex signal processing. 

In addition, the occurrence of poor image quality 

15 due to a degradation in S/N ratio and new signal 

saturation in the imaging device can be suppressed 
effectively by controlling the target exposure value 
properly in the exposure control means . 

With the Bayer arrangement imaging device in 

20 particular, the interlaced frame readout allows the 

addition of pixels arranged in the vertical direction 
to be performed within the horizontal transfer path and 
the addition of pixels arranged in the horizontal 
direction to be performed in the external circuit to 

25 the imaging device. It therefore becomes possible to 

add together signals from multiple pixels arranged in 
the vertical and horizontal directions with the above 
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advantages . 

Additional advantages and modifications will 
readily occur to those skilled in the art. Therefore, 
the invention in its broader aspects is not limited to 
5 the specific details and representative embodiments 

shown and described herein. Accordingly, various 
modifications may be made without departing from the 
spirit or scope of the general inventive concept as 
defined by the appended claims and their equivalents. 



